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* NOTICES * 



Japan Patent Office is not responsible for any * ' " ^ 

damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



[Claim(s)] 

[Claim 1] In remote control equipped with the remote system which photos a perimeter environment, 
and the local system which is connected to the remote system through a transmission line, and controls 
the photography condition of said remote system The transmission part to which said remote system 
transmits and receives data through said transmission line, The camera section which obtains the image 
data of said perimeter environment, and the camera control section which outputs the condition data in 
which said camera section is controlled and the condition of said camera section at that time is shown 
according to the control data received from said local system through said transmission part. The 
outputted condition data and the image data obtained in said camera section are mixed. It has the data 
multiplexer section which outputs the mixed data to said transmission part. Said local system The 
camera control unit which generates the actuation data for operating the camera section of said remote 
system, The transmission part which transmits and receives data through said transmission line, and the 
data separation section which divides into said image data and condition data said mixed data received 
from said remote system by the transmission part. It is based on the actuation data generated by the 
separated condition data and said camera control unit. Remote control characterized by what the control 
data transmitted to said remote system is generated, and it has the data-processing section which 
performs predetermined processing to said separated image data so that it may be adapted for the control 
data, and the image output section which displays the processed image data for. 
[Claim 2] Remote control according to claim 1 characterized by having fiirther the synchronous 
processing section which processes synchronously by storing said mixed data temporarily between the 
transmission part of said local system, and said data separation section. 

[Claim 3] In remote control equipped with the remote system which photos a perimeter environment, 
and the local system which is connected to the remote system through a transmission line, and controls 
the photography condition of said remote system The transmission part to which said remote system 
transmits and receives data through said transmission line, The camera section which obtains the image 
data of said perimeter environment, and the camera control section which outputs the condition data in 
which said camera section is controlled and the condition of said camera section at that time is shown 
according to the control data received from said local system through said transmission part, The 
outputted condition data and the image data obtained in said camera section are mixed. It has the data 
multiplexer section which outputs the mixed data to said transmission part. Said local system The 
transmission part which transmits and receives data through said transmission line, and the synchronous 
processing section which stores said mixed data received from said remote system by the transmission 
part in the received sequence temporarily [ predetermined part ], and outputs said mixed data in the 
accumulated sequence. The data separation section which divides into said condition data and image 
data the newest mixed data stored in the synchronous processing section, The data-processing section 
which generates the control data transmitted to said remote system based on the condition data and 
image data which were separated, and is outputted to said transmission part, Remote control 
characterized by what it has for the image generation output section which generates and outputs image 
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data from said mixed data outputted from said synchronous processing section. 
[Claim 4] In remote control equipped with the remote system which has the controUed-system-ed 
section, and the local system which is connected to the remote system through a transmission line, and 
controls said controUed-system-ed section The transmission part to which said remote system transmits 
and receives data through said transmission line, The image data of said controUed-system-ed section is 
obtained, and it has the camera section which outputs the obtained image data to said transmission part. 
Said local system Remote control characterized by what it has for the transmission part which transmits 
and receives data through said transmission line, and the data-processing section which generates the 
control data to the controUed-system-ed section, and is outputted to said transmission part based on the 
image data which received from said remote system by the transmission part. 
[Claim 5] A remote system mixes the condition data in which the control state of said controlled- 
system-ed section is shovra, and said image data. It is what has the data multiplexer section which 
replaces the mixed data with said image data, and is outputted to said transmission part. Said local 
system It is what has a data separation means by which said transmission part receives said mixed data 
from said remote system, and divides the received mixed data into said condition data and image data. 
Remote control according to claim 4 characterized by for said data-processing section also taking said 
separated condition data into consideration, and generating said control data. 

[Claim 6] It is remote control according to claim 1 to 5 which a remote system has the encoding section 
which changes the image data from said camera section into predetermined formal data, and is 
characterized by said local system having the decoding section which restores the predetermined formal 
data which received by said transmission part and were obtained to image data. 

[Claim 7] The image input section for inputting an image as the exterior and the transmission part which 
transmit and receive data through a network. The 1 st formal transducer which changes the inputted 
image data into predetermined formal data. The data-processing section which performs predetermined 
data processing to the data relevant to control of an external device. The data multiplexer section which 
mixes the data processed by the data-processing section and said predetermined formal data, and outputs 
the mixed data to said transmission part. The data separation section which divides into predetermined 
formal data and addition data the mixed data received from said outside by said transmission part, and 
outputs said addition data to said data-processing section. Remote control characterized by having the 
2nd formal transducer which changes the separated predetermined formal data into image data, and the 
image output section which outputs the changed image data. 

[Claim 8] Said predetermined data processing which the data-processing section performs is remote 
control according to claim 7 characterized by being processing according to said addition data. 
[Claim 9] Remote Control System characterized by combining two or more said remote control 
according to claim 7 or 8 with said network. 

[Claim 10] Remote control according to claim 1 to 8 with which image data is characterized by 
including voice data. 

[Claim 1 1] Claims 1, 2, 3, and 5 characterized by the data size of predetermined formal data and said 
mixed data being the same, or remote control given in seven. 

[Claim 12] Predetermined formal data and/or said mixed data are remote control claim 6 characterized 
by being DVC formal data, or given in seven. 

[Claim 13] Said data multiplexer section and/or said data separation section are remote control claims 1, 
3, and 5 characterized by recording and/or reproducing said condition data and/or said addition data to 
the sub-code section of DVC formal data, or given in seven. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to remote control which controls controlled systems-ed, 

such as a camera of a remote place, and a robot, from a terminal at hand. 

[0002] 

[Description of the Prior Art] With digitization of an image or voice, and the spread of digital 
communication networks, a remote conference system, remote monitoring system, etc. using a digital 
image are put in practical use in recent years, and the situation that remote control which operates a 
camera, a robot, etc. of a remote place from a terminal at hand to coincidence is needed has occurred. 
[0003] Drawing 8 is drawing showing the example of a configuration of the conventional remote 
control. At the terminal (remote system 100) in a remote place, the image captured in the camera section 
101 is digitized in the encoding section 102, and is outputted to a transmission line 300 through a 
transmission part 103. Moreover, data are changed in the decoding section 202 and the data received 
from the transmission line 300 through the transmission part 201 are expressed in the image output 
sections 203, such as a monitor, as the terminal (local system 200) of a user's hand. A user operates the 
camera section 101 of a remote system 100 by the camera control unit 204, looking at the screen of the 
image output section 203. This actuation will be performed by receiving the command from a local 
system 200 through a transmission part 103, and the camera control section's 104 interpreting that 
command, and controlling the camera section 101 by the remote system 100, if the camera control unit 
204 outputs a command to a transmission line 300 through a transmission part 201 to a remote system 
100. 

[0004] Moreover, when clocks of operation differ, in order to prevent the frame omission resulting from 
the frame number of the image which a remote system 100 captures in fixed time amount differing from 
the frame number of the image which a local system 200 outputs etc. with a remote system 100 and a 
local system 200, it had the memory buffer which is not illustrated between a transmission part 201 and 
the decoding section 202, and the structure holding the data of a predetermined frame number is 
established. 
[0005] 

[Problem(s) to be Solved by the Invention] however, in the above remote control Since the processing 
time starts in case data conversion is performed in the encoding section 102 or the decoding section 202, 
the image currently displayed on the image output section 203 For the user who differs from the image 
which the camera section 101 is photoing at the time, depends on the image of the image output section 
203, and is operating the camera control unit 204 After giving directions, because of the time delay until 
it obtains the image of a result with which the camera section 101 actually moved as directed, 
responsibility was bad and operability was bad. 

[0006] Moreover, when it had the memory buffer, the technical problem that delay became large fixrther 
occurred. 

[0007] Furthermore, since delay arose as mentioned above, information required for control was not able 
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to be extracted from the image information which becomes impossible [ generating the control 
information over a robot's etc. controlled system on real time ], and is generally called a visual servo, 
and the technique of generating the control information over a controlled system was not able to be 
applied. 

[0008] In consideration of such a technical problem of the conventional remote control, this invention 
can lessen a time delay and aims to let responsibility and operability offer good remote control. 
[0009] 

[Means for Solving the Problem] In remote control equipped with the local system which this invention 
of claim 1 is connected to the remote system which photos a perimeter environment, and its remote 
system through a transmission line, and controls the photography condition of a remote system The 
transmission part to which a remote system transmits and receives data through a transmission line. The 
camera section which obtains the image data of a perimeter environment, and the camera control section 
which outputs the condition data in which the camera section is controlled and the condition of the 
camera section at that time is shown according to the control data received from the local system 
through the transmission part, The outputted condition data and the image data obtained in the camera 
section are mixed, and it has the data multiplexer section which outputs the mixed data to a transmission 
part. A local system The camera control unit which generates the actuation data for operating the camera 
section of a remote system. The transmission part which transmits and receives data through a 
transmission line, and the data separation section which divides into image data and condition data the 
mixed data received from the remote system by the transmission part, It is based on the actuation data 
generated by the condition data and camera control unit which were separated. It is remote control 
which has the data-processing section which performs predetermined processing to the image data 
separated so that the control data transmitted to a remote system might be generated and it might be 
adapted for the control data, and the image output section which displays the processed image data. 
[0010] In remote control equipped with the local system which this invention of claim 3 is connected to 
the remote system which photos a perimeter environment, and its remote system through a transmission 
line, and controls the photography condition of a remote system The transmission part to which a remote 
system transmits and receives data through a transmission line. The camera section which obtains the 
image data of a perimeter environment, and the camera control section which outputs the condition data 
in which the camera section is controlled and the condition of the camera section at that time is shown 
according to the control data received from the local system through the transmission part, The outputted 
condition data and the image data obtained in the camera section are mixed, and it has the data 
multiplexer section which outputs the mixed data to a transmission part. A local system The 
transmission part which transmits and receives data through a transmission line, and the synchronous 
processing section which stores the mixed data received from the remote system by the transmission part 
in the received sequence temporarily [ predetermined part ], and outputs mixed data in the accumulated 
sequence, The data separation section which divides into condition data and image data the newest 
mixed data stored in the synchronous processing section. It is remote control which has the image 
generation output section which generates image data and is outputted from the mixed data outputted 
from the data-processing section which generates the control data transmitted to a remote system based 
on the condition data and image data which were separated, and is outputted to a transmission part, and 
the synchronous processing section. 

[001 1] In remote control equipped with the local system which this invention of claim 4 is connected to 
the remote system which has the controlled-system-ed section, and its remote system through a 
transmission line, and controls the controlled-system-ed section The transmission part to which a remote 
system transmits and receives data through a transmission line, The image data of the controlled-system- 
ed section is obtained, and it has the camera section which outputs the obtained image data to a 
transmission part. A local system It is remote control which has the transmission part which transmits 
and receives data through a transmission line, and the data-processing section which generates the 
control data to the controlled-system-ed section, and is outputted to a transmission part based on the 
image data which received from the remote system by the transmission part. 
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[0012] The transmission part to which this invention of claim 7 transmits and receives the exterior and 
data through a network, The image input section for inputting an image, and the 1st formal transducer 
which changes the inputted image data into predetermined formal data, The data-processing section 
which performs predetermined data processing to the data relevant to control of an external device. The 
data multiplexer section which mixes the data and predetermined formal data which were processed by 
the data-processing section, and outputs the mixed data to a transmission part, The data separation 
section which divides into predetermined formal data and addition data the mixed data received from the 
outside by the transmission part, and outputs addition data to the data-processing section, It is remote 
control equipped with the 2nd formal transducer which changes the separated predetermined formal data 
into image data, and the image output section which outputs the changed image data. 
[0013] 

[Embodiment of the Invention] Hereafter, the gestalt of operation of this invention is explained, 
referring to a drawing. 

(Gestalt 1 of operation) Drawing 1 is the system configuration Fig. showing remote control of the gestalt 
of operation of the 1st of this invention. That is, the remote system 6 in which the gestalt of this 
operation has the camera which photos a perimeter, and the local syste m 14 for a user to operate a 
remote system 6 are connected through the transmission line 7. As a transmission line 7, if ATM, 
Ethernet, Fiber Channel, IEEE1394, SMPTE259M (SDI), the telephone line (ISDN), etc. can transmit 
digital data, a class will not be asked. Moreover, as a gestalt of connection, various things, such as one 
to one (Point to Point), one to many, and many to many (network), are possible. Moreover, it may be a 
cable or you may be wireless. 

[0014] A remote system 6 consists of the camera section 1, the camera control section 2, the encoding 
section 3, the data multiplexer section 4, and a transmission part 5. 

[0015] At least one or more parameters which are needed for photography of perimeters, such as 
migration of each axial (x y, z) direction of a three-dimensions coordinate, rotation of the circumference 
of each shaft, a zoom, and a diaphragm, are adjustable, and the camera section 1 is equipped with a 
controllable function by the camera control section 2. The image photoed in the camera section 1 is the 
encoding section 3, and is changed into predetermined formal data. Here, as predetermined formal data, 
although the digital data (it considers as DVC data hereafter) of a DVC format is raised as an example, 
you may be anhedron-type digital data, such as an MPEG format, a JPEG format, and a D-VHS format. 
[0016] In addition, it is Digital in DVC. Video It is the abbreviation for Cassette and is constituted by 
data signals, such as an image, voice, and a sub-code. Drawing 2 shows the configuration of DVC data. 
Although one frame (NTSC 1/30 second) consists of ten trucks, it shows a part for the one truck by 
drawing 2 . Each truck consists of AV data areas 33 containing the header field 30, the sub-code field 
31, the AUX field 32, an image, and/or voice data etc. 

[0017] The data multiplexer section 4 embeds the condition data of the camera section 1 inputted from 
tiie camera control section 2 to the sub-code field of the DVC data inputted from the encoding section 3, 
generates mixed data to it, and outputs the mixed data to it at a transmission part 5. In a sub-code field, 
since 5 bytes can be written in the part expressed with SC of drawing 2 about one truck, 150 bytes of 
embedding is possible at one frame. Therefore, the size of the DVC data inputted into the data 
multiplexer section 4 and the mixed data with which condition data are embedded and outputted 
becomes the same. Condition data are available in the absolute value about each parameter of the 
camera section 1, or a relative value. A transmission part 5 has the fiinction which outputs the DVC data 
outputted from the data multiplexer section 4 to a transmission line 7, and the ftinction which outputs the 
control data inputted from the transmission line 7 to the camera control section 2. 
[0018] A local system 14 consists of a transmission part 8, the data separation section 9, the decoding 
section 10, the data-processing section IJ^ a camera control unit 12, and the image output section 13. 
[0019] The mixed data inputted through the transmission line 7 are received by the transmission part 8, 
DVC data and condition data are separated in the data separation section 9, DVC data are outputted to 
the decoding section 10, and condition data are outputted to the data-processing section 11. The 
decoding section 10 decodes DVC data to bit map data etc. and the analog data of the format that it can 
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download to a computer through the capture board which is not illustrated, and outputs the data to the 
data-processing section 11 . In the data-processing section 11, while the actuation data inputted from the 
condition data inputted from the data separation section 9 and the camera control unit 12 generate the 
control data which should be sent to the camera control section 2, the image data inputted from the 
decoding section 10 is processed, and an indicative data is outputted to the image output section 13. 
[0020] By the above configuration, even if encoding/decoding takes time amount, since condition data 
and the control data of a camera pass along another root by the data multiplexer section 4 and the data 
separation section 9 with image data, they become possible [ pressing dovm to the minimum delay ]. 
[0021] Next, an example of processing in the data-processing section 11 in the gestalt of implementation 
of the above 1st is explained, referring to a drawing. 

[0022] Drawing 3 is drawing showing an example of the image data processed by the data-processing 
section 1 1. In drawing 3 , screen 31 a-e is a screen corresponding to time of day tl-t5 inputted into the 
data-processing section 1 1, and screen 31 f-j is the image which the camera section 1 photoed to the 
same corresponding time amount with screen 31 a-e, respectively. Suppose that there is no actuation to a 
camera till time of day tl . Although it is the image with the appearance same [ screen 31a and 3 If of 
screens ] at this time, it differs as data. That is, screen 31a is photoed by the camera section 1 before 
time of day tl, and 3 If of screens is photoed by the camera section 1 at time of day tl. Moreover, 
suppose that partial image 32a (part surrounded by the dotted line) of the core of screen 31a is outputted 
and displayed on the image output section 13 here. 

[0023] Now, suppose a camera that actuation of moving to the right was made from the camera control 
unit 12 in time of day tl . Since there will be delay by the time this actuation is reflected in the image 
output section 13, although 3 Ig of screens which the camera section 1 operated as directions of the 
camera control unit 12, and were photoed is obtained, in time of day t2, screen 31b becomes the same 
thing as 3 If of screens which are the image which the camera section 1 in time of day tl photoed. The 
data-processing section 1 1 calculates a motion of a camera with condition data and actuation data, starts 
partial image 32b which is the part which corresponds when a camera is operated on real time from 
screen 31b, and outputs it to the image output section 13 as an indicative data. 

[0024] Next, suppose that actuation of suspending migration of a camera from the camera control unit 
12 in time of day t2 was made. Screen 3 Ic in time of day t3 is the same as that of 3 Ig of screens, and 
3 Ih of screens tums into a screen in the condition of moving to the right too much for a while from the 
screen which the user meant by delay at the time of control data being transmitted from a local system 
14 to a remote system 6. In the data-processing section 1 1, a part is started from screen 31c and it 
outputs to the image output section 1 3 so that count may be performed from condition data and actuation 
data like previously, and control data which returns the camera which moved to the right too much to a 
right location may be outputted and partial image 32b and partial image 32c may become almost the 
same. 

[0025] In time of day t4, although 3 Id of screens is the same as 3 Ih of screens, they cut down 32d of 
partial images from 3 Id of screens so that it may become the almost same image as partial image 32c. 
At this time, screen 3 li becomes the image data photoed in the right location with the control data which 
the data-processing section 1 1 in time of day t3 outputted. 

[0026] In time of day t5, since screen 3 li photoed in the right location is inputted as screen 31 e, the 
data-processing section 1 1 starts the core of screen 3 le as partial image 32e again, and outputs it to the 
image output section 13. 

[0027] By performing the above processings in the data-processing section 1 1, the user who operates the 
camera section 1 of a remote place using the camera control unit 12 can acquire feeling which is being 
operated on real time. 

[0028] In this case, at the time of rotation actuation of not only migration of each shaft orientations of 
the camera section 1 but the circumference of each shaft, rotation (pan) on either side is right-and-left 
scrolling of a screen, and up-and-down rotation (tilt) can acquire the same effectiveness by vertical 
scrolling of a screen. Moreover, the same effectiveness is expectable by performing the image 
processing corresponding to each condition also with a zoom or a diaphragm. 
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[0029] Moreover, also in the configuration to which the synchronous processing section which adjusts 
the image which stores data temporarily, and is outputted and inputted exists in a remote system 6 
and/or local system 14 side for cures, such as frame omission, this invention is effective. 
[0030] When considering as the configuration which has the above synchronous processing sections, the 
synchronous processing section may perform the following actuation, namely, when the camera section 
1 is standing it still and there is no change in an image When the synchronous processing section carries 
out the queuing of the mixed data of a predetermined frame number and mixed data are inputted 
exceeding a predetermined frame number When the output to the data separation section 9 is required in 
the condition that delete the data for one frame and the queuing of the one frame is not carried out In 
case the data outputted immediately before are outputted once again, it processes so that frame omission 
etc. may not arise, and control to the camera section 1 is performed, all the data by which the queuing is 
carried out are deleted and processing which presses down a time delay is performed with outputting the 
newest data. Since an image with little delay is obtained while the image stabilized by this while the 
camera section 1 was standing it still is obtained and the camera section 1 is moving, actuation becomes 
easy. 

[003 1] Moreover, it has audio input units, such as a microphone, and the camera section 1 can also be 
changed into digital data with an image in the encoding section 3. In that case, the decoding section 10 
also supports voice and should just equip a local system 14 with audio output devices, such as a 
loudspeaker. 

(Gestalt 2 of operation) Drawing 4 is the system configuration Fig. showing remote control of the gestalt 
of operation of the 2nd of this invention. Among drawing, the same number as drawing 1 is the same, 
and omits explanation. Here, the decoding section 16 and the image output section 13 constitute the 
image generation output section. 

[0032] In drawing 4 , the mixed data sent to the local system 18 through a transmission line 7 from the 
remote system 6 can be received by the transmission part 8, and are once stored in the synchronous 
processing section 15. The synchronous processing section 15 has a buffer for at least one frame, and 
has the fimction which carries out the queuing of the mixed data sent from the transmission part 8. 
[0033] In case an image is generally outputted and inputted in digital one, it is necessary to synchronize 
digitizing but, and this is difficult when connecting with the remote place like the gestalt of this 
operation, therefore, from the difference in the delicate clock by the side of a remote system 6 and a 
local system 18 etc. The synchronization of digitizing cannot be taken well. For example, when the 
digitizing of a remote system 6 is earlier Since the direction of the data inputted from the data outputted 
from the synchronous processing section 15 of a local system 18 increases, A buffer overflows and the 
direction of the data conversely outputted from the synchronous processing section 15 when the remote 
system 6 is later increases, also when there are no data in a buffer, it must output, and frame omission 
will arise. 

[0034] For this reason, in the synchronous processing section 15, when the data for one frame are 
deleted when a buffer is covered with the data of a predetermined frame number, or it becomes less than 
a predetermined frame number conversely, one certain frame was copied, processing in which data were 
increased to a predetermined frame number was performed, and buffer overflow and frame omission are 
prevented. Furthermore, the synchronous processing section 15 outputs the mixed data for creating the 
indicative data which outputs the mixed data by which the queuing was carried out to the very end to the 
data separation section 9, and is outputted to the image output section 13, in order to calculate control 
data required for control of the camera section 1 at the decoding section 16 to the sequence by which the 
queuing was carried out. Since delay by the queuing is pressed down by this to the minimum, a visual 
servo etc. can use the technique of generating control data based on image data. 
[0035] For example, it is available to the system which follows a camera, controls it and records the 
result on a video tape etc. so that it may continue photoing the specific descriptions (human being's face 
etc.) like an automatic-checking-and-continuous-monitoring system, and it is very effective to set up 
independently the path which outputs an image so that frame omission etc. may not arise in this way, 
and the path which outputs the image for controlling a camera. 



h g eg b eb eg e e 



Page 6 of 7 



[0036] Furthermore, since the image recorded on a video tape and the image which controls a camera do 
not have the need of completely synchronizing, a visual servo can be performed even when the working 
speeds of a remote system 6 and a local system 1 8 differ. In that case, a timer can be formed in the data- 
processing section 17, and more exact control can be realized by measuring spacing as which condition 
data are inputted into the data-processing section 17. 

[0037] Moreover, the camera section 1 can be equipped with audio input units, such as a microphone, 
tfie encoding section 3 and the decoding section 1 6 can respond also to voice, and the configuration, 
then voice which the image output section 1 3 equips with a sound recorder system can also be processed 
to coincidence. 

[0038] In addition, when using DVC data as input data, the difference between predetermined formal 
data and mixed mode data is only the sub-code section, and although it processes two kinds, mixed data 
and predetermined formal data, since the sub-code section does not influence, the decoding section 16 
can completely process these two kinds of data similarly at the time of decoding of an image or voice. 
(Gestalt 3 of operation) Drawing 5 is the system configuration Fig. showing remote control of the gestalt 
of operation of the 3rd of this invention. 

[0039] The remote system 40 equipped with the controlled-system-ed section 41 and the local system 47 
which generates the control data for controlling the controlled-system-ed section 41 are systems 
connected by the transmission line 46, and the gestalt of this operation is the system which can operate 
controlled systems-ed, such as a robot, by remote control. 

[0040] In a remote system 40, the controlled-system-ed section 41 is a robot etc., it is controlled by the 
controlled-system-ed control section 42, and the motion is photoed by the camera section 43. The 
photoed image data is changed into predetermined formal data, such as DVC data, by the encoding 
section 44, and is sent out to a transmission line 46 through a transmission part 45. Moreover, the sent 
control data is sent to the controlled-system-ed control section 42 through a transmission part 45 from a 
transmission line 46. 

[0041] On the other hand, in a local system 47, after receiving the predetermined formal data sent from a 
transmission line 46 by the transmission part 48 and changing them into the decoding section 49 at 
image data, such as delivery and a bit map format, it is sent to the data-processing section 50. In the 
data-processing section 50, from the inputted image data, the condition of the controlled-system-ed 
section 41 is calculated, the following control data is generated according to directions of the control 
panel which gives the directions to the data-processing section 50 and which is not illustrated, and it 
transmits to a transmission line 46 through a transmission part 48. 

[0042] Moreover, by obtaining the condition data of the controlled-system-ed section 41 from the 
configuration which formed the data multiplexer section 5 1 in the remote system 40, and formed the 
data separation section 52 in the local system 47 like drawing 6 , then the controlled-system-ed control 
section 42, generation of control data is attained also not only from an image but from condition data, 
and a system with more high safety can be realized. 

[0043] Remote control systems, such as a robot using DVC data, are realizable with the above 
configuration. Since a processing unit is not required for a remote system 40, a remote system can be 
built comparatively cheaply. Moreover, by connecting two or more remote systems to one local system, 
only a local system side is equipped with a large-scale processing unit, a remote system side is 
considering as a cheap system, and the centralized control of two or more remote places is also possible 
for it. 

(Gestalt 4 of operation) Drawing 7 is the system configuration Fig. showing remote control of the gestalt 
of operation of the 4th of this invention. 

[0044] In drawing 7 , the image input sections 61 are photography equipments, such as a camera, and 
the photoed image is changed into DVC data in the codec section 63. The image output sections 62 are 
indicating equipments, such as an NTSC monitor, and display on a screen the analog data changed from 
the digital data in the codec section 63. It mixes in the sub-code section of the DVC data into which the 
data inputted from the data-processing section 65 were inputted from the codec section 63, and it outputs 
to a transmission part 66, or the data separation multiplexer section 64 separates the data of the sub-code 
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section from the DVC data inputted from the transmission part 66 conversely, and outputs them to the 
codec section 63 and the data-processing section 65. It connects with the external device which is not 
illustrated, and the data-processing section 65 generates the signal for controlling an external device 
based on the data inputted from the data separation multiplexer section 64, and inputs the various 
parameters of an external device, and outputs them to the data separation multiplexer section 64. It 
connects with the external transmission line which is not illustrated, and a transmission part 66 outputs 
and inputs the data from the data separation multiplexer section 64. 

[0045] Here, the codec section 63 constitutes the 1st formal transducer and the 2nd formal transducer. 
Remote control 60 is constituted by the above. 

[0046] A bidirectional image communication link and remote control become possible by connecting the 
remote control 60 of the above configurations through transmission lines, such as two or more and 
ATM. Since DVC data are used, even if it mixes / separates an image/voice data, control data, or various 
parameters in the data separation multiplexer section 64, since data size is eternal, saving of the amount 
of transfers is possible for it. Furthermore, other processings, such as control of a robot, can perform to 
coincidence, transmitting or displaying an image. 

[0047] In addition, image recording regenerative apparatus of the image input section 61 and the image 
output section 62, such as VTR, are sufficient as either of them, or both. 

[0048] Moreover, although the 1st formal transducer and the 2nd formal transducer were constituted 
from a gestalt 4 of the above-mentioned implementation using the codec section 63, it replaces with this 
and is good in each formal transducer also as a separate configuration using the encoding section and the 
decoding section respectively. 

[0049] Moreover, although the data multiplexer section and the data separation section were 
summarized by the data separation multiplexer section 64 and were constituted from a gestalt 4 of the 
above-mentioned implementation, it replaces with this and is good also as a respectively separate 
configuration. 

[0050] Moreover, either of them or both do not need to be equipped with an image recording 

regenerative apparatus, then the codec sections 63, such as digital VTR, and the data from the data 

separation multiplexer section 64 may be outputted [ the image input section 61 and the image output 

section 62 ] and inputted to the direct image input section 61 and the image output section 62, or either. 

[0051] Moreover, an external device is chosen according to the contents of the data inputted from the 

data separation multiplexer section 64, or the data-processing section 65 can choose processing. 

[0052] Moreover, when the image input section 61 is equipped with audio input units, such as a 

microphone, the image output section 62 is equipped with audio output devices, such as a loudspeaker, 

and the codec section 63 considers as the configuration corresponding to voice, bidirectional 

image/voice communication between the remote places using DVC data are realizable. 

[0053] The delay of this invention is effective in realizing little remote control as mentioned above. 

Moreover, even if there is delay, good remote control of operability is realizable for a user. 

[0054] Moreover, the amount of data which it is possible to embed control data to image data and/or 

sound data, and is transmitted to a transmission line can be saved. 

[0055] 

[Effect of the Invention] This invention can lessen the time delay in remote control so that clearly from 
the place described above, and it has the advantage in which responsibility and operability become good. 

[0056] Moreover, since the condition data in which the condition of the camera section is shown, and 
the image data obtained in the camera section are mixed and transmitted, there is an advantage that the 
amount of data transmitted to a transmission line can be saved. 



[Translation done.] 
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